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ABSTRACT 
; The ways many people view higher education today are 


examined, especially some of the ways evaluators, researchers, and 
others are assessing college benefits and college impact. Trends 
toward getting a college @ucation without going to college are 
discussed, with reference to the evaluation design of the 
imput-environment-out put model. College effects of collége impact or 


environmental influencés are defindd as what #s left after input 
_a@kfferences have been accounted for. This maodel is Criticized for 


suggesting that four years in college ‘has no significant impact ona 
student. Suggestions are offered that depart from the common, . 
experimental, cause-and-effect research model... A contextual nodel is 
proposed for- evaluating student development in college. The basic 
features are suggested by the words: experience ‘and events, 
environnent, and effort, leading to development and. "impress." 
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The Higher Education Program at the University of Arizona was 
established first in thé early 1960's and reorganized in 1974 to expand . 
as an area of scholarly inquiry, research, instruction, and public J. 
service. The Program conducts studies, pyojects, conferences,’ and forums 
and makes the results available to other institutions and eran wi the ‘3 
mutual concerns. Graduate degree programs are designed to prep two ¢ 
types of administrators: generalists who coordinate policy deve Aaant 
_and decision ing and specialists who facilitate the flow of technical 
information and\provide expertise in a special area. Regearch progr 
are conducted in) critical areas,pf public policy concern whether it be 7 
state or regional, national, or international in’scope. Similayly, - 
public service projects. are conducted in major fields of policy study 
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and development. The long-run goals of the Higher ¢Education Program J 

are to contribute, to the *contiauing change and improvement in the 

administration of Higher Education through the education of its gradu- “ L-y 
ates and the improvement of public policy through ips penearch studies §” 

and (public service projects... : 2 { 


The Program's publications are designed to be relevant ‘to ee 
of the University, to the State of Arizona, and to‘yolleges and pepe 
sities throughout «the country. They can be obtained on a limited basi 
by institutions and associations which are able to exchange publications 
‘of a comparable type. Others may obtain copies for $2.00 each, which 
includes mailing, handling, and printing costs. Inquiries should be 
addressed to the Chairman, Committee on Higher Education, University oF 
Arizona, 1415 North Fremont Street, Tucson, | Arizona 85719. 
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7 Pe : , / nae 7 eee 
me aara: theme ae this essay is that the ways many er are. a 


a. 
viewing higher _ education today$" and especially sdme of the ways Hailes, 
hf 


researchers, and qthers are assessing college benefits a college iusseniie 
4 t nee 


are teading to some "curious conclusions, bags of thegd@¥onclustons nee 
4 

based « on accurate knowledge, within the conithes of the concepts and 

methods by which the knowledge was produced. But accurate Npeetenee is 


not NpehSeanely adequate knowledge nd may leadg@o curiously inadequate 
(gs 
4nd incorrect judgments * So, ‘I propose to examine some of our curious 
~ conclusions and note what makes them curious. - 


* 


But first, I'd like to set the stage, introduce a few characters, 


7 


and reflect on some past research. ; = = 
~ * . 
Twenty~£tve to fifty years aud the ia a of going to ee 
for those who wanted to 8Q and were qualified and coufd afford it--was 


aia taken for granted. In those days higher education. was ety 
’, private, moStly en not a uase activity, and not much of a demand g 
: a : 
on a state Budget. Now, it's mostly public, less selective, increasingly 
a mass activity, and a very petals item in state budgets. : , 


A 
As more and more ote. have canennteeed ‘higher ‘education, more and 
; ™ 


s 
more people have had gomething to say about aes ans encounter may have 


been their own experience of goths to college, or their children's 


' : F i ; 4 2 
experience; or it may just-be reading the“newspaper, watching television, BS 
paying state and local/taxes, and talking with friends. In an¥ case, ie 
‘who thinks what about higher education is increasingly important-- “A 


‘ a 
op a ; . 


e : ; 
\ s especialty when the “who" includes governors, legislators, members of 


4 


coordinating councils, lawyers, efficiency experts, taxpayers, parents, 


and students; and when the "what" seems to generate a lot of heat. 


Was it Harry Truman who said, "If you can't stand the heat, get out 


wr 
- ‘ 8 


of the kitchen"? ‘College faculty members don't really spend much time in 


the kitchen, some of them not at all; they're in the living room and the 


 f 


library. In the library a few of them read about’ what's going on in the 


« —_ 


kitchen. In the living room more of them talk about what's going on in 


> 


the. kitchen and what they think is wrong: the buyer is paying too much 


- 


for poor quality; the dietician is not ordering the things that are good 
' 


for you; the chef is not mixing amd processing the ingredients for best 


results; and the waiter doen't have a proper regard for gracious dining.. 


Well, what comes out of the’ kitchen ds what you're going to eat. 


@ 


- 


Let me remind ‘you of what was served up to us about 20 years ago, - 
around 1956, by Philip Jacob,* a political sciéntist who reviewed a 


number of research studies in a widely quoted.monograph called Changing 


Values in College. College students were described as unresponsive, 
self-certered, and littlé changed by their exposure to four years of 
: ; 
"education beyond high school. Their attitudes and values were largely 


unaffected, it was said. Much of what they are taught is impractical or 


— * 


unimportant, and quickly forgotten. Such personality development as may - 
« 


occyr is minimal or short-lived. ' For the most part,,.adolescent immaturity * 


- ww . 


is mere ly prolonged. Ang@gher obseryer likened the American college to a 
vast WPA project, giving adolescenes something to do while keeping them 


So : mal 
*Philip Jacob, Changing Values in Colfege y—New Haven: .Hazen Foundatioy, 1956. 
my 3 3 . . 
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‘ . . 4 : . 
off the job market, and also keeping faculty members off the streets. In 


- x 


view of that~dlleged misergble record, one would suppose that the last 


rites were about to be performed. _ Incidentally, Philip Jacob was really 


' 
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- Various alumni surveys consistently oe. that, if they had to do it 


‘1 A f 
léoking for impact on values’ that might be attributed to social studies 
: ’ . q . 


. 


courses. Considering the total college experience of a full-time resident 
\ a, 24 - 
student, how much of it can be classified as social studies courses? 
% 


Perhaps 5%, and probably no more than 10 or 15%. Far too’ much educational 


research has consisted of efforts to find large significance in small 4 


if : 
phenomena, and then generalizing the failure beyond the limits of the 


« 


. . 
‘For a paper I wrote in 1962* I reviewed a somewhat ee me ee of 
- s ‘ : 


PESeHEeH related to the value of higher education and college impact; and, 


~ 


ly opposite conclusion, I noted, 


2 ; ; . \ 
as you might expect, L arrived at a total 
A ~z / 


for example ,* that’ the rine (oF students going bo college had more than 
doubled in the peeve 20-year ory and that ‘end who experienced 
higher edycation vere precisely the ones who valued it most , and who 
wanted more of it for thenselves and for theix children. A Fortune 
survey by Elm Roper in 194 reported that 62% of a cross sectiorkKjof i 
saulte aaa thes would oe boy to go ta walvede, and 50% said 
thts about their girl. In 1961, a ere Roper survéy indicated that 


69% of parents with children under 18 expected that their children would 


go to college, and’ yids expectation was the game for girls as for boys. 
eee a : » Fis ~ 


s ‘2 ie 


a 
*C, Robert Pace, "The College Environment as an Exemplar of Values," 
pages 7-23 in Higher Education in California. Working papers for the 
first afinual California:conference on higher education, California 
Teachers Association, 1962. ° a, ~ 
: ‘ : =3- 
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basic general education and ABR ctation of ideas; and,thts goal was 
* 


’ 


over again, 80 to 30% would not enly go to COnTER but to the same college. 


“In a NORC survey, of students graduating ih 1961 gg said they expected ‘i 


to go to graduate school. Then’I looked at sotme studies of what people 
thought about the importance of caviiua woats or objectives. There was a 


ortune survey of alumi in 1949 reporting that the three mos& important 
: ‘4 Sed , Fe w < im” 


alues of college were: training for a particular = er profession; 


eae dal better trained ming in dealing with all eu of problems; and, 


the fctedideence and wisdom necessary to jive a full life. About that 
time I dida survey at Syracuse in which we asked ippereiaeanen: 


i fe 
fagulty, and alumi about the importance of various goals. The interest- 
‘ ‘a Ee < 
ing) point here is that there was a very high degree of agreement among all e 


three groups. In a Cornell survey of men at 11 colleges and ini ve rete lee, 


the |most important objective of college education was believed to be a 
% , F 


al ae more strongly by upperclassmen than by students in their : 
, ) , 


first or second years. They also said that the opportunity to,go to 


college was very important ‘to them (96%), that mmost of what they were 


learning was "very worthwhile" (75%), and that the colleges were doing a -7 


good job (80%). I then looked at evidence from achievement tests and 


zg 


found further support for the conclusion that the college experiente was 


\ 
indeed influential. Suffice it to say here-that all test-retest Studies 


t 
4 i. 


showed mean gains, most of them noe large and significant; and Giese 
4 v 3 < 
eoeeed a variety of subleeks and whit eeuececianaus socia] sciences, ; Pe 
~~ 


math, literature, arts, "and measures of critical thinking. Incidentally, 


I've yet to find any study showing that students knew less at the end of 


x . 


a 
a ? =i 
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| she oe a a 
a course than they did at thé beginning. Interests / attitudes . values; 
a in a broader sense, “personality, 6 change in college. I found 47 / 
instanced in the research terature in ‘shich- a ‘tést given to — 
was subsequently given to the same students . FUE years. “later. és 75% 


~*~ 


of those instances there’ was a.significant change. “these tests patuseeaty ‘ 


Sa 


measured accibuiee toward sjarihus topics such as war, Negroes, religion, 
etc. ; economic, social, /political,/religisus, esthetic, and theoretical 
Lak or orientations; and stich aspects of personality as ethnocentrismy mi 
‘authortvarteadun, social adjustment, Ep Deane and independence. 


a . . 


Well, so much for a bit of past history Mout what gome research 
shows and doesn't show re the values BY hice education: vintage 1940 
e 1960; To me, the research showed that going to college was an aca 
ence that was widely wanted and walnes that those who bal it valued Ta 
especially and wanted more ola ate that satan typical jg believed that 

; they/had made progress toward ‘: pokye whcteh both mney and the faculty 
regarded as important; and from a variety of tests it was evident that, ° 
‘typically, students” gained pn breadth and ce of knowledge, in important 
iterieotaal skills and abilities, Sha that their attitudes ana yates : 
were Ne ae modified. iii ; a ms 
as let's see what people are aeyene about higher educalion today. 

In the spring of 1972 I gave a speech at Lawrénce University in 
Appleton, iceconstes on he occasion of its centennial year. The first 
part of that aoanul illustrates how some of the concerns and civieien i ad 

_about higher education have changed sharply, just within the past decade, 


 F 


tw “ 


s ae e a . / . . tr : 


Seg ad ' . 
aes int Mygces two viewpoints which I then want to explore further. So, 
here are a few observations I made in that speech. * 


"Some years ago there was a Broadway musical caljed 'How to Succeed 
in Business Without Really Trying." ,Im higher education today o : 
ofthe featured attraction might be called ‘How to get a college 
education without really going to college.' This remarkable . | 
result can be adhieved through such means as credit by) examination,, 
the university without walls, the extended univer8ity, the off- Zt 
‘ campus degree program,.and other variations and improvements on. 

what, in an earlier time, might haye been called extension programs 
and correspondence coursés. : . ‘ 
"It is common advertising practice to use nice words in describing 
whatever it is you want to promote and to use bad words in describing 
whatever it is you aim to replace. So, we have flexible and individ- 

_ ualized altefndtives to traditional education--we break the lockstep + - 
of the four-ye program, enabling people to learn at their own rate,~ 
we give credit’ for achievement and we ts competente rather than 

’ time Bent or classes attended. a 


"In another decade or so cies college campus will be obsolete, so it 
< seems. The college professor® will be replated by the electric plug. 
a ~ Young and old can hook into the exciting riches of television, tape 
cassettes, and cqmputer consoles. And we can all wear headsets so 
as not to disturb the neighbors. is 
5 y 
"Moreover, there are too many young people in gollege who don't 
genuinely want to Be in college. The campuses harbof too many ; 
alienated, permissive, pot-smoking youth; or is it too many radicel 
activists plotting revolutiong to remake society? , Why should our ' 
tax dollars or our hard- eared ‘savings support such” places? Maybe 
some sound business management is needed to eliminat€‘waste, promote 
efficiency, operate on a balanced budget, and show us exact ly what >, 


we are getting for our dollars, \ ) 2 ; 
. : we 
"In any case, it is surely still true that pe education té being | 
' evaluated widely -and vigorously by the publié, by students, and by , 
the profession itself. It is therefore important to, know how it is 
being evaluated: Who is making what dbsegwations? What goals or 
purposes are assumed? What consequences are being explored? And 
most important of all, what cbncepts about the enterprise of educa- 
tion itself are ae what to look for and how to interpret ae 
the results? : , a 


*C. Robert Pace, "Who Needs, Colle es?", unpublished speech given at 
Lawrenge University, May 16, 1972. 
hala ; 
-6- : 
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’ "One vie holds that ddiiewtton is an end result, a product, an ¢ 
? achievement. It is what one knows, and what skills one has. Its — 
attainment is measured by final exams and term papers and scores 
on objective achievement ° tests. After all, we don't give grades 
r for character, or fot interests, attitudes and values, or for effort, 
or for good habits. Educational research and evalyation J given , . / 
this cancept of’education, consists of trying to find out. what 
. treatments--that is, What methods, materials, sequences, and other 
; modes of learning and instruction--produce the specifically-desired 
’ results with the greatest efficiency and econony.. One needs, of 
* course, to be quite clear about the specifically-desired results. 
The current jargon for this is behavioral obj@ctives. - Achievement: 
we <. test items are the operational definitions of these behavioral 
- 2 ‘ objectives. A erent | is successful if those who have it score 
: ; higher than those whddon't--other things being equal. The pressure 
for accountability and for economy has led to an acceptance of ~ 
scigntifically-clothed conchusiongs about such things as the virtue 
, ° of programmed instruction, the ecdnomy of large classes, and the 
i efficiency of teaching and ae ae to “speci figally-defined ‘ 
¢ behavioral objectives. | ga, 38 . . 


a 4 


follow a programmed lesson, or to look ata , television screen. If 
we define education solely ds: the-possession of certain. knowledge 
and skill, we already know that many people can pass the tests 

‘ without ever setting foot a coldge campus. To thse who can, 
let us by all means give them a certificate or a degree attesting « 
to their achieyement. But let ys not equate their achievement wand 

, ‘ ' the a “Of going i collegeR@ P 


% ae "One does not need to be on a,coflege campus to read @ book, or to 
~ 


"There is a ‘eet Rerent view or concept which holds that education is ,,/ | 
“Also process, a particular kind of experience. Education is a 
proc in which one engages intellectually, emotionally, and actively. 
, The institutional setting iri which the experience or process of educa- 
- tion takes place has a special importance and leaves a special 
' impression on the minds and memories of those who experience it. I'm 
' quite sure, for example, that coming upon the paintings of Goya in the 
« . Prado museum or in the cathedral at Toledo is very different from 
e séeing them in the pages of an art history book. Seeing the Grand 
Canyon in Arizona is different from seeing it in the National 
Geographic. So, too, there seems to be a lasting imprint that eomes 
from being ‘in such p¥aces as Harvard, Yale, Princeton, Dartmouth, 
Amherst, Michigan, Wisconsin, Chicagoy Berkeley, and Brigham Young, 
and many other colleges and universities across the land of varying 
degrees of distinction or distinctiveness or. of speci mGanens to 
‘ those who have attended then. 


gh 
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‘ "Over the years I've known a good many* people who graduated from Yale 
or who have taught there. Without exception, and with little or no 
‘ provocation, -they talk about Yale with ai with criticism, with 


JS : “™. : . ; 
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4  * The ty, * JLuation design Bonny is an ae -environment-out put 


J 


f Mme | 
‘concern, with Interest, and with great affection. It's “anazingl? 
But I’ also sure that: it's not unique to Yale. - I suspect it's | 
because colleges and universities,°at their best, offer a kind of 
experiénge t offered by. any other major institution in our 
culture.. f - oa ; a 
"A college or university isa habitat, a society, a community, an ~ 
environment. As such, its” value might be judged by the quality of . 
life that it fosters, the opportunities for experience and explora- 
ee ee ae concern for growth, for cnrlehment; and for 
lture that it exemplifigs. The question is not just ‘what does 
your machine produce?'.but .also "how does your garden grow?!" 
» i 
So,’ the “context “of criticism has turned to criteria of productivity, 


ReGHnEL OEAGee efficiency, costs, return on Amvestoene, gndcbtudtes of some- 
, . 


thing called output with something catled AO PUR Semen ae controlled. And, 
in contrast, a more “humanistic and personal Pee ener: and ecdlogical 


view. of education is demanding recognition. 


a : Sed 


model. Co! Pe or silane impact ®t snvheaunenal influences are 


’> 


defined as what's left after-input™ aifferenges have been accounted for. . 
; x 


. 


The virtue of =the model is that it guards against attributing to the 


=p ‘a 


environment a result that is predi¢table without any environmental inter- 


e ; , 
vention. But Ithe vice of the maust is that it makes some obvious 


BAveEPPRERAN indlueneda impossible t dnc acntee, Suppose high scores 

on measures of thagrertedt orientation, ‘complexity, sind thinking intro- 
version aye relevant ,and desired outcomes for,Swarthmore. Suppose Satudénta’ 
scores ‘on these measures at entrance, are as high © and that 

tngetal and final scores are- highly correlated, The inevitable conclusion / 
would be that Agheine four years in-the aes Rothouse environment of 


Swarthmore where such values are constantly rewarded has no impact on 


; oe 
students! Within the logic: of the research model, that conclusion is . 


; , 
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accurate. It e~also very curious! If the rank order of talent of UCLA 


- basketball players as seniors is highly predictable from their talent as 


freshen, then John Wooden's coaching had no impact--even though all : 


spheyers improved markedly. Obviously no-one at UCLA would believe suc 


Fi 
- F ~ 


a: enttou statement. 


My general uneasiness with the input-environment-output model is 


~ 


philosophical as well as technical. I'm not sure thay ROR USC ey or 


sie de model is the right way, or even a’ cepiiebte way, to think about’ 


- 


the EHEpOne and function and a of higher education, and to ae . 


its impact on Students The more’ eyecitic and limited an objective is, 
the easier it is to devise a series of lessons to assure that students 
will attain it, and therefore demonstrate "impact" and ‘ausnunkanditiy” 
to a gullible Slee But the _ of such small parf% does not add up 
to the whole of higher education; in fact ,® it may well add up to ashe 
éottion of higher! education. My own interests,in evaluation are with 
more global purposes--one typically associated with general or liberal 

5 sealer: depth of understanding in a discipline, and eicwileape. values, 
and skills relevant to a profession. What on marth is mastery learning 
with respect to such goals as noraltdeve opnent, intalicccunt emma) 
and skepticism, esthetic sensitivity, crittes thinking, awareness of 


velatronsniye and CORSE HEDEES an fy ceuatartine of how nioiei vex is 


created and truth a and replaced by dafper insights, or the 
recognition of quality and excellence and virtue? 

‘ “NS 

Nevertheless, governors, legislators, taxpayers, and many new 


students*‘are asking, "What are we getting for our investment?" So we 
a9- ) 
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_ tell them how many students graduate or drop out, what the faculty 
eeschine load is and the cost per credit hour, and who gets what kind of 
jobs. hy accepting the validity of the question and trying to answer it 
in productivity terms, we reinforce the productivity concept of what higher 
sdamiedtian is all iia | Perhaps we ourselves ‘should be asking different 


questions and trying to answer them in different terms. 


We might agree, for example, that the national interest in 


consumerism, truth in advertising, etc., is fdne and dandy. But ,we should 


point out that it has little if any-validity: or application to most college 
Z., university education. It's true that the consumer (student) is buying’ 
‘ 


the opportunity ‘for a particular sort.of experience and that he expects 


4 


value. But the consumer is not buying a product. In-¢educa- 


3 


this to be of 
tion, the tongumer ‘is the product! 


Another curious conclusion today is that the economic value of a 
college education is aitiks less than it used to be. That's true; but it's 
jalso curious. Let's consider an analogy. Suppose that going to church 
results e scvaeiun: In:a time when few people go to church, the chosen 
few me are. saved are conspicuous from the pagan masses. But now suppose 
that evéryone or nearly everyone goes to church and is therefore saved. 
Does this really mean that salvation is of any less value? I wouldn't 

“think so. I would think dither that salvation was the “good fortune of 
many more people; so Halleluia, or praise Aljah!. 


The indicators commonly used for showing college benefits are 


separatély liable to much misintetpretation. For example: 
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.Y 
Single criteria, such as GRE scores or percent of students going 
to graduate school, are not appropriate for all kinds of institu- 
tions. Some institutions have vocational purposes rather than 
- general education (GRE) -purposes. Some institutions are primarily 
terminal .rather than preparatory for further education. ~ i 


Single criteria, such as p ree of entering students ,who sub- 
sequently obtain a degree, are not appropriate for all kinds: of 
institutions--especially for community colleges which, by this 
criterion, would have to be described a national disaster. 


Single criteria, such as obtaining a job in a field related to 
one's college study are also’ inappropriate, partly because some 
college graduates do not enter the job market, partly because 
who gets what sort of job depends as much or more on the general 
state of the economy (which colleges do not control) as on the 
vocational emphasis of one's college courses, and partly because 
many students do not choose a major field for its vocational 
relevance in the first place. 


ee: Basically the reason this is so is that, despite many similarities 


among colleges and among college students, not all institutions have the 
same purposes, nor do all students have the same talents and aspiration. 
I stated this in my book The Demise of Diversity?* as follows: 


. * 
"Our image of higher education was not one that saw it as many 
different institutions each trying to do the game thing, and 
achieving some uniform goal with greater or lesser success.... 
Rather, we viewed higher education as a legitimately diverse 
enterprise in which certaig kinds of institutions eiphasize” 5p 
goals to a greater extent hag others and whose influences may 
be generally congruent with t differences in emphasis." 
(page 21) 


Note also the following point of view, ggain quoted from The Demise of 


: Diversity?: y 


- se 


"Information about alumni or about-upperclassmen does not readily 

lend itself to proving that college caused-their subsequent béhavior 

and status in life or their current interests and attainments. Never- 

theless, college graduates and college students, as consumers of 

higher education and former or current participants in the experience 

of higher education, are uniquely qualified to report on the benefits 
*C. Robert Pace, The Demise of Divetsity? A Comparative Profile of Eight. 
Types of .Institutions. Berkeley: Carnegie Commission on Higher Education, 


1974. 
; Xe -11¥ = B* 
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and influences of going to college. They have individually 
contributed to the quality of- their own college experience and 

\ selectively consumed the variety of opportunities for learning and »& 

development which college made available to them. In thid sense, 

it is inappropriate to consider them as educational 'products' 

comparabke to the products gf a factory which receives jand processes 

“raw material. They were rather well-developed material when they 

arrived on the college campus, having some 18 or more years of prior 

development with all the cumulative experiences of inheritance and 

family, neighborhood,” friend$, church, and prior schooling. While 

college offers a kind of experience not of fered hy any other major 

institution in our culture, it is also for the person experiencing ¥ 

it part of a cumulative life history. “One “cannot separate education 

from-all other experience in some cause-and-effect relationship. At 

the same time, an evaluation of higher education which ignored the 

reflections and subsequent lives of alumni or the interests and 

judgments of current students would surely be inadequate and in- 

complete. An exploration of patterns of association between college' 

experiences, personal background, type of institution attended, and 

various student and adult activities, viewpoints, and ,characteristics 

can throw some light on how the divérse system of higher education 

operates in its’natural setting." (pages *21-22) 


‘ 
Embedded in the above two quotes are the \following propos fions: 
Educational development oacurs within\ a larger epntex of personal Yi 
development - \ 


' What students get out of college depends on what they put into it; 
theyyare selective consumers of the ae a that are theoretically 


bate * ie ’ 


One! can identify broad patterns of association but not’ cause and 
effect relationships in any rigorous sense; the‘ variables are too 
volatile, too interrelated, and the important criteria are too 
global. : 


\ 


The criteria “I cited above are not personal (psychological) development 
obiverta;, with the exception of thefcognitive “iti and knbwledge measured 
‘by the GRE. In fact, most nationwide comparative stddies in higher sduiias 


wv 
tion have been made in relation ¥o sociological or behavioral indicators, 
i r) 


such as droppfng out, graduating, getting’a Ph.D., employment, income, etc. 


When the purpose of inquiry is to determine the relative influence of 


various personal and environmental conditions on some objective outcome, 
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; 1 \ 
measure (such as dropping out of college), and the data base is a’ 


ae ; : 
heterogeneous population of stents distributed over a diverse set of - 


2 ™ ‘ A 
institutions, the input-environment-output research model as used by... ~~ 


> 


Alexander Astin i appropriate. The main reservation I have] is the case 


in which an outcome measure is a ‘personal characteristic that is more 

or less identical to a pexsonel siavactactaeat uded as an input measure. 
An- example would be i scores as an input mead&ure and an output measure — 
yhich has a heavy component of verbal and mathematical facility such as 
GRE scores. In that Saw maseauieleivtroumencat influences are guar- = 
anteed to be nidduats for maximum influence would. require that those 
with the Honeeh SRE scores subsequently nde the highest GRE scores, and 


~~ 


vice versa. No educational program is designed to produce -such a result. 
Rigbadiie then, if an input and output characteristic are highly corre- 
lated in the first place, the search for environmental. in luences or 
differential impact. automatically becomes a search for small differences. 

a eae , I : = 
While there dz nothi g logically faulty about the input-environment- 
output model even er these conditions, one needs to be aware that the 
cards are stacked against finding snvconseddal influences, and that.some ' 
of the exneneiens may tieretore be a bit curious. } 

I don't have any patented alternative model ‘guaranteed to produce 
conclusions that are less curious than some of the models I have 
criticized. ‘But I've’ been thinking about it for some time, and I do 
‘have some suggestions which depart radically from the oe experimental 


cause-and-effect research model. We could, for example, abandon the . 


notion that it's necessary to control for student input in order to 


ALI 
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c ; > \ 
determine college impact. And we could abeffdon the concep college | 
’ : d a ' 3 
deel impact, and think instead about student development and college impress. 


‘ These heretical ideas have their origin in a clinical and developmental 1. a 


rs) , ‘ Ns - 
perspective rather than in a comparative, statistical perspective; and : ‘ay 
: er ‘ AY 
e. their relevance is for local institutional self-study rather than for 


national system-wide studies. In local studies theré is no real \ 
\ 


necessity to hae comparative data. The fact that students who’ come to 
the college are different from students whe go to: some other college is | Ae 
irrelevant. The local questions’is Stupty this: given the students 

whé6 come here, what happens to near anil what are they like when they leave? 

In the spit seniegrdhment~ourpue- model, the envirohment is ‘is black ae id 
box, the machinery which causes or aypiadne differences in Fie me uderie k | 
between arrival and departure. Suppose we turned this upside down &nd ; 

said that the @nvironment is the input in-the sense that it's what's there 

in the first place, the initial given. The college--its curriculum, 

faculty, Santiieiess resources, policies, etc\--exists before the Seni 

comes to it. The question then is to eon how students » use the environ- 
Cy ment, how the nature and villas of phat they d influences their own 


os 7’ 


development, and how the environment presents oppor tint exes and rewards 
“Por student responses. , : ~ . 
I refer to this emergent modgl of mine as a contextual model for 
‘evaluating student development in dollege. The basic features of the 
model are suggested by the words: experience and events, tions: 


and effort, leading to development and.impfess. Now let me illustrate 


what I mean by these words. 
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Experience and Events 


ms Experience ‘consists of, events. 5 


Events Lave a quality as a ma - 
This quality or meaning is the resultant of the interaction between 
the experiencer-and the world, or physical event. 
The meaning of an he PEP et ares tonsists of the context which 


" the experiencer Prints to it and the context of: the physical Avent. 


MRE RENAE experience consists of the events that occur in a college, | 


environment. aie 3 
; ' “e J 
a Stace the wappntoicer is an integers! and inseparable part of the. 


. peaning or mgAty of ah event, fhe tees eative of the PapEESERCEE 
(knowledge, ability, personality, etc.) that are brought to bear on any .. 
eke eh are part - the event itself; ard therefore sapanunacedsaty 

co "it would seem pam and petnaps inappaipriate to treat eradenr | 

; i MRE as "input" to be "parcelled out" in reséarch deatene 


‘ 


for seuayine "college effects." is Z a . : e 


_ So, the first major feature of a contextual model for studying 


college effects is to eliminate the separate treatment of variables that 


~~ have heretofore been defined as student input. . 
. : ae 
ry 


. Environment 


” Plas : bow 
The college environment consists of the events and experiences that 


1‘ - 


. occur in it, reflecting the purposes of the institution and how it 


functions. 


\ Deke purposes and functions are rey aled. operationally by the 


2, Te ; 
clarity and SER EP EE with which they are perceived by the people who live. 


in the environment, based: on their experiences. . 
a 
| 3 meas 
juabere are three basic i of dimensions that characterize/and i 


differentiate among college environments: a) personal development 


\' + dimensions; b) relationship dimensions; and c) system maintenance, and 
bd 
\ system change dimensions. . a pe 


U7 


»Pe¢sonal development dimensions: reflect the purposes of the 


institution, that is,.‘to afford opportunities for and give emphasis to 


. 


the learning and development of studants. There are four major lines of 


student development which are the concern, to a greater or lesser degree, 
a ‘ 
of all colleges and universities: a) academic--scholarly--intellectual; 


b) esthetic--expressive--creative; c) critical--ev uative--sociétal 


' 


concern and personal commitment; and d) vocati 
. \ 


al--occupational compe- 


tence. 


Relationship dimensions assess the extent to which individuals are 


cy 


involved in the énvironment, tend to support and help one another, and 


. 


generate a sense of belonging. There are two major aspects that are 


ie important and that can be differentiated: 4) peer group relationships; 


and b) relationships between students and faculty, administrators, and 


[ other officials. 


System maintenance and system change dimensions refer to how the “75 Be 


: if 
institution operates as an institution, that is, to its bureaucratit-- 


organizational--regulatory——and. innovative features. j 


¢ 


#- 


In most, and perhaps all but the most homogeneous environments, 
5 os 4 ,€ ; 


the strength of these environmental dimensions dw emphases will differ 


from one part-of the environment to another--as-betwéen engineering and 


fine arts, or be gyeen residents and commuters, for example--so that an e 
’ er 


‘ 


adequate characterization Ge Re environment of the college or university 


is gue which permits differences to be revealed, if there are such, be- 


. 2 . 


tween major segments of the environment. : 
: : 
In addition, the potency of environments for influencing student 


development depends on certain qualities of and relationships among 


the various dimenes pis as well as on their séparate strength. These 


- 


qualities and relationships probably involve at least three further 
observations or measurements--intensity, pervasiveness, and congruerne. . 


Thus, a particular environmental dimension (events and experiences) may 


be typically intense or i accor | bland; it mdy be pervasive across time 
and place within the environment or it may be sporadic or localized; and 


the environtental emphasis felt in one part of the environment may be 
. a / 4 
congruent or dissonant with the emphasis in another part of the! 


me Seaenre : ‘ 


i ‘ . 


\ So, the second major feature of a contextual model for studying 
\ 
college effects is the identification of the environmental contexts in 


i aaa events and experiences occur. 


, 


FAX 
Effort and Exposure 


With rare, and perhaps no exceptions, all learning and development 


in college involves some degree of effort on the part of the student. 
How much one\learns depends Sa ehe effort made to learn it. 


. 


eS bo 


| 1 4 
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~~ 


Effort, whether large or small in amount, also has a quality dimension. 
The quality bf cognitive effort can range from low-level cognitive activities 


») Sines 
such as memorizing facts, principles, and terminology, to higherflevel 
ioe | 


gee activities of application, analysis,: synthes{s, and critical j 


evaluation. The quality of affective effort fcan range| from disinterest and 
indifference’ to more positive responses reflecting increasing levels of 
-interest, enjoyment, {and satisfaction. The quality of|energy or behavior 


can range from pagsive to active, from silent spectator to active participant 


and public advocate. 


Quality, like frequency, is a vertical dimension fanging from high to 
low. Activity scalien, in which the response indicates |frequency, but the 
‘content reflects levels of quality, can thus provide simultaneously a 
measure of amount and of quality, Such scales could bé developed for 
_ dif ferenteaspects of college experience--classroom leafning, extraciricular 

‘activities, peer group nee my ee 
. Another dimension of effort is horizontal rather than vertical. This 
is the after made to extend the range of events and 4 eriences to which 
one is exposed. The word exposure is used to designate this additional — 
dimension of effort. :, 

So, the third feature of a gontextual model for studying college dies. f “ 

x the identification of the quality of effort invested by the student in 
‘ che educational enterprise. This feature is related t ane enlargement and 


enrichment of the context which the experiencer brings to the events 


encountered. 
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. stimuli of increasing breadth, depth, and integration. i 


) 


~ 


* Development p x * 


x ae 
The contextual base 9{ the expertence may be ee of as 


readiness to respond to the events and experiences of the college envi- 
ronment,/ The events and experiences then presumably enlarge the 
contextual base of the experiencer, enabling the student to respond to 
oe 

The extent and @irection of this development or evolution is 


further influenced by the context of the environment which events 


’ ~ 


and experiences occur, plus the quality of effort investd by the 
experiencer. 

Development, presumably following this general ue 4 inferred 
from the difference in scores on criterion measures at ‘two points in 


time. 


> 
Imptess 
While impress, in the sense of making an impression on or leaving 


a mark on the student, can be inferred from differences between before 


— and after, status on relevant criterion measures, one can and I think 


should also regard impress as a amteondl feeling r belief on the part 
of he student. _ Thus impress would be inferred’ fom self-reports of - 
change and progréss toward desired goals, benefits ak co to events 
and experiences, and expressions of satisfaction with college. Addi- 
tionally, impress also implies a more aaketie mark and hence would also 
be ‘measured after college by indications of continued interests, out- 
looks, concerffS;~etc., related-to intellectual, esthetic, Noe 


social, occupational, and ethical criteria. 5 , 


=i9= 
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One of the virtues of this model or line of thinking, to me at 
any ratg, is that it holds both the student’ and the college accountable. 
The student/is accountable for the quality of investment x effort he 


makes in furthering his own jearning and development; and the college is 


' ' o 


accountable for providing the events and”the environmental context 


a» 


designed to stimulate learning and development. 


One of the memorable lines from John ‘Keonedy-g inaugural address 


was, "Ask not what your country can do for you, ee | can do for 
. , a . 4. 


‘ , 


your country." Today, in, evaluating higher education we should not 


“ a 


does colfege do for the student, but also what does the 
P ve: : 
student do with the opportunities which college presents. 


simply.ask what 
3 — 

If we eo these questions, and in relationship to each 

other, we will be focusing on the edycativg@\purposes of colleges and 


- 


universities and may arrive at judgments which are less curious than 


ed 


¢ 


judgments based on more limited or perhaps less relevant anc aie ; 
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